Signal processing apparatus and endoscope system

ABSTRACT

A first signal processing apparatus includes: an image processing unit configured to at least execute a composition process of generating composed image information in which first image information or second image information and textual information are superimposed; and a control unit configured to control the process of the image processing unit in accordance with communication with a second signal processing apparatus. The control unit selects either one of the first image information and the second image information, and when the second image information is selected, the control unit outputs a first command for instructing the second signal processing apparatus not to superimpose the second image information and the textual information related to the second image information, and causes the image processing unit to generate composite image information in which the second image information and the textual information related to the second image information are superimposed.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of PCT international application Ser.No. PCT/JP2016/053850 filed on Feb. 9, 2016 which designates the UnitedStates, incorporated herein by reference, and which claims the benefitof priority from Japanese Patent Applications No. 2015-185258, filed onSep. 18, 2015, incorporated herein by reference.

BACKGROUND

The present disclosure relates to a signal processing apparatus and anendoscope system.

In the medical field, an endoscope system is used for observing internalportions of a subject. The endoscope typically inserts an insertion unithaving a thin and long shape into a subject such as a patient, emitsillumination light supplied by a light source apparatus from a distalend of the insertion unit, and receives reflected light of theillumination light by an image sensor, thereby capturing an in-vivoimage. The in-vivo image captured by the image sensor of the endoscopeundergoes predetermined image processing by a signal processingapparatus (processor) of the endoscope system, and thereafter isdisplayed on a display of the endoscope system. A user such as a doctorobserves an internal organ of the subject based on the in-vivo imagedisplayed on the display.

In endoscopic inspection, since various endoscopes are appropriatelyused in accordance with the purpose of observation and an observedregion, a plurality of endoscopes is used in combination in some cases.An endoscope system includes a processor, a display, and a recordingapparatus as a set for individual types of endoscopes. Therefore, in acase of using a plurality of endoscopes in combination, a plurality ofsets of processors, displays, and recording apparatuses is installed inaccordance with each of the endoscopes. This results in complication ofa wiring structure among the apparatuses and a necessity to ensure awide area for installation, leading to enlargement of the entire system.In order to simplify the configuration of the entire system, there is aproposed configuration in which two processors are connected to eachother, and one of the processors performs as a parent device output ofimage information to a display or a recording apparatus, thereby sharingthe display or the recording apparatus by a plurality of processors (forexample, refer to JP 2003-038432 A).

SUMMARY

According to one aspect of the present disclosure, there is provided afirst signal processing apparatus to which a first endoscope apparatusincluding a first image sensor is detachably attached, the first signalprocessing apparatus being communicably connected to a second signalprocessing apparatus to which a second endoscope apparatus including asecond image sensor is attached, and being configured to process animaging signal generated by one of the first image sensor and the secondimage sensor, the first signal processing apparatus including: an imageprocessing unit configured to at least execute a composition process ofgenerating composed image information in which first image informationbased on the imaging signal generated by the first image sensor of thefirst endoscope apparatus or second image information input from thesignal processing apparatus based on the imaging signal generated by thesecond image sensor of the second endoscope apparatus and textualinformation related to the first image information or to the secondimage information are superimposed; and a control unit configured tocontrol the process of the image processing unit in accordance withcommunication with the second signal processing apparatus, wherein thecontrol unit selects either one of the first image information and thesecond image information, and when the second image information isselected, the control unit outputs a first command for instructing thesecond signal processing apparatus not to superimpose the second imageinformation and the textual information related to the second imageinformation, and causes the image processing unit to generate compositeimage information in which the second image information and the textualinformation related to the second image information are superimposed.

According to another aspect of the present disclosure, there is providedan endoscope system including: a first signal processing apparatus towhich a first endoscope apparatus including a first image sensor isdetachably attached; and a second signal processing apparatus to which asecond endoscope apparatus including a second image sensor is attached,wherein the first signal processing apparatus and the second signalprocessing apparatus are communicably connected to each other, and theendoscope system performs signal processing on an image signal generatedby the first image sensor or by the second image sensor, and wherein thefirst signal processing apparatus includes: an image processing unitconfigured to at least execute a composition process of generatingcomposed image information in which first image information based on theimaging signal generated by the first image sensor of the firstendoscope apparatus or second image information input from the signalprocessing apparatus based on the imaging signal generated by the secondimage sensor of the second endoscope apparatus and textual informationrelated to the first image information or to the second imageinformation are superimposed; and a control unit configured to controlthe process of the image processing unit in accordance withcommunication with the second signal processing apparatus, wherein thecontrol unit selects either one of the first image information and thesecond image information, and when the second image information isselected, the control unit outputs a first command for instructing thesecond signal processing apparatus not to superimpose the second imageinformation and the textual information related to the second imageinformation, and causes the image processing unit to generate compositeimage information in which the second image information and the textualinformation related to the second image information are superimposed.

The above and other objects, features, advantages and technical andindustrial significance of this disclosure will be better understood byreading the following detailed description of presently preferredembodiments of the disclosure, when considered in connection with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating a general configuration of anendoscope system according to a first embodiment of the presentdisclosure;

FIG. 2 is a flowchart illustrating setting of a standard mode or acompatible mode by a control unit of a first processor illustrated inFIG. 1 and a processing procedure of control processing of internalprocessing of the first processor in accordance with individual modes;

FIG. 3 is a flowchart illustrating a processing procedure of compatiblemode control processing illustrated in FIG. 2;

FIG. 4 is a diagram illustrating an exemplary composed image displayedon a display device connected to a conventional processor as a parentdevice;

FIG. 5 is a diagram illustrating an exemplary composed image displayedon a display device in the endoscope system according to the firstembodiment;

FIG. 6 is a flowchart illustrating setting of a standard mode or acompatible mode by the control unit of the first processor illustratedin FIG. 1 and another processing procedure of control processing ofinternal processing of the first processor in accordance with individualmodes;

FIG. 7 is a schematic diagram illustrating a general configuration of anendoscope system according to a second modification of the firstembodiment;

FIG. 8 is a flowchart illustrating a processing procedure of thecompatible mode control processing by the control unit of the firstprocessor illustrated in FIG. 7;

FIG. 9 is a schematic diagram illustrating a general configuration of anendoscope system according to a second embodiment;

FIG. 10 is a flowchart illustrating a processing procedure of thecompatible mode control processing by the control unit of the firstprocessor illustrated in FIG. 9;

FIG. 11 is a diagram illustrating an exemplary composed image displayedon a display device in the endoscope system according to the secondembodiment;

FIG. 12 is a schematic diagram illustrating a general configuration ofan endoscope system according to a first modification of the secondembodiment; and

FIG. 13 is a flowchart illustrating a processing procedure of thecompatible mode control processing by the control unit of the firstprocessor illustrated in FIG. 12.

DETAILED DESCRIPTION

Hereinafter, a signal processing apparatus (processor) of an endoscopesystem will be described according to embodiments of the presentdisclosure (hereinafter, referred to as “embodiment(s)”). Note that thepresent disclosure is not intended to be limited by these embodiments.In the drawings, same reference signs are attached to the same portions.

First Embodiment

FIG. 1 is a schematic diagram illustrating a general configuration of anendoscope system according to a first embodiment of the presentdisclosure.

As illustrated in FIG. 1, the endoscope system according to the firstembodiment uses, as an endoscope (scope) to be introduced into asubject, a first scope 2A attachable to a first processor 3 (signalprocessing apparatus, first signal processing apparatus) or a secondscope 2B attachable to a second processor 4 (another signal processingapparatus, second signal processing apparatus), for example. Theendoscope system according to the first embodiment includes the firstprocessor 3, the second processor 4, an input apparatus 5, a displaydevice 6, and a server 7. The first processor 3 performs predeterminedimage processing on an imaging signal transmitted from the attachedfirst scope 2A. The second processor 4 performs predetermined imageprocessing on an imaging signal transmitted from the attached secondscope 2B. The input apparatus 5 receives an input of various types ofinstruction information and inputs the received instruction informationinto the first processor 3. The display device 6 displays a video imagecorresponding to an imaging signal obtained by one of the first scope 2Aand the second scope 2B. The server 7 is connected to and communicateswith the first processor 3 via a network, or the like, and recordsvarious types of information. In the first embodiment, the firstprocessor 3 is communicably connected with the second processor 4 towhich the second scope 2B is attached, and also is connected to theinput apparatus 5 and the display device 6. The first processor 3controls image processing including a composition process in the firstprocessor 3 according to communication with the second processor 4,thereby generating a composed image from which necessary information maybe sufficiently read as a composed image in which textual information issuperimposed on image information, input from the second processor 4.

Each of the first scope 2A and the second scope 2B is introduced intothe subject and generates image information of an internal portion ofthe subject by imaging the internal portion of the subject. The firstscope 2A is connected to the first processor 3, and the second scope 2Bis connected to the second processor 4.

The first scope 2A includes, at its distal end portion, an image sensor21A (first image sensor), a memory 22A, and an operation switch unit 23Aincluding various operation switches such as a release button. Thesecond scope 2B includes, at its distal end portion, an image sensor 21B(second image sensor), a memory 22B, and an operation switch unit 23Bincluding various operation switches such as a release button.

Examples of the image sensors 21A and 21B include a CCD image sensor anda CMOS image sensor. A light receiving surface of the image sensorincludes a plurality of pixels arranged in a matrix. Each of the pixelsreceives light from the subject onto which light is emitted andgenerates an imaging signal by photoelectrically converting the receivedlight. In a case where the first scope 2A is attached to the firstprocessor 3, the image sensor 21A performs noise reduction processing,clamp processing, and A/D conversion processing onto a first imagingsignal (analog) generated by the plurality of pixels, and outputs thesignal as a first imaging signal (digital) to the first processor 3 viaan electric cable (not illustrated). In a case where the second scope 2Bis attached to the second processor 4, the image sensor 21B performsnoise reduction processing, clamp processing, and A/D conversionprocessing onto a second imaging signal (analog) generated by theplurality of pixels, and outputs the signal as a second imaging signal(digital) to the second processor 4 via an electric cable (notillustrated).

The memories 22A and 22B record the identification information and themodel numbers of the scopes 2A, and 2B, the type of the image sensors21A and 21B, or the like. The memories 22A and 22B may record variousparameters for image processing on the imaging signals captured by theimage sensors 21A and 21B, such as parameters for white balance (WB)adjustment. In a case where the first scope 2A is attached to the firstprocessor 3, the various types of information recorded by the memory 22Ais output to a control unit 35 of the first processor 3 by communicationprocessing with the first processor 3 via an electric cable (notillustrated). In a case where the second scope 2B is attached to thesecond processor 4, the various types of information recorded by thememory 22B is output to a control unit 44 of the second processor 4 bycommunication processing with the second processor 4 via an electriccable (not illustrated).

Each of the operation switch units 23A and 23B includes a plurality ofbuttons for operating the first processor 3 and peripheral equipmentsuch as an air supply apparatus, a water supply apparatus, and a gassupply apparatus. Each of the operation switch units 23A and 23Bincludes a release button. In a case where the release button is pressedduring scope inspection, each of the operation switch units 23A and 23Binputs a release signal into the control units 35 and 44 of each of theprocessors 3 and 4. The release signal instructs generation of stillimage data (release image data) from the image displayed on the displaydevice 6 in a case where the release button is pressed. In accordancewith the input of the release signal, each of recording image generators36 and 45 to be described below generates release image data based onthe video image displayed on the display device 6 at the input timing ofthe release signal. A bending knob for bending the first scope 2A andthe second scope 2B and an insertion port for inserting a treatmentinstrument are provided in the vicinity of the operation switch units23A and 23B.

The first scope 2A is detachably attached to the first processor 3. Animage processing unit 31 to be described below generates first imageinformation Dg1 by performing predetermined image processing on thefirst imaging signal transmitted from the attached first scope 2A. Thefirst processor 3 is also communicably connected with the secondprocessor 4. The first processor 3 transmits various commands to thecontrol unit 44 of the second processor 4. The first processor 3 selectsone of the first image information Dg1 generated by the image processingunit 31 and second image information Dg2 input from the second processor4, and then, generates a composed image by superimposing the selectedimage information and textual information related to the imageinformation, and outputs the composed image to the display device 6. Thefirst processor 3 generates recording image information from thegenerated composed image and outputs the generated information to theserver 7. The first processor 3 includes an image processing unit 31, apanel switch unit 33, an external video image input port 34, the controlunit 35, a recording image generator 36, and a storage unit 37.

The image processing unit 31 performs predetermined image processing onthe first imaging signal generated by the image sensor 21A of the firstscope 2A. The image processing unit 31 generates the first imageinformation Dg1 by performing optical black subtraction (OB) processing,demosaicing processing, white balance (WB) adjustment processing,electronic zoom processing, edge enhancement processing, mask processingon the first imaging signal (digital) generated by the image sensor 21A.The image processing unit 31 outputs the generated first imageinformation Dg1 to an image selector 354 to be described below. Theimage processing unit 31 includes a composing unit 32, converts thecomposed image (composed image information) generated by the composingunit 32 into a format that may be displayed on the display device 6, andoutputs the converted image. Note that there is a case where the imageprocessing unit 31, instead of the image sensor 21A, performs noisereduction processing, clamp processing, and A/D conversion processing onthe first imaging signal (analog).

The composing unit 32 executes on-screen display (OSD) processing, thatis, processing of generating a composed image by superimposing imageinformation that has undergone predetermined image processing andtextual information related to the image information. The textualinformation is information indicating patient information, deviceinformation, examination information, or the like. The composing unit 32generates a composed image by superimposing the image information inputfrom the image selector 354 to be described below and the textualinformation related to the image information. In a case where the firstimage information Dg1 is input, the composing unit 32 generates acomposed image by superimposing the first image information Dg1 and thetextual information. In a case where the second image information Dg2 isinput, the composing unit 32 generates a composed image by superimposingthe second image information Dg2 and the textual information.

The panel switch unit 33 is a switch group provided on a front panelconstituting a casing of the first processor 3. In a case where thefirst scope 2A is attached to the first processor 3, the panel switchunit 33 receives an input of signals for freeze, release, and imageadjustment (emphasis, electronic enlargement, color tone, etc.) onto thein-vivo image captured by the first scope 2A, and outputs the receivedvarious signals to the control unit 35.

The second image information Dg2 output from an image processing unit 41of the second processor 4 is input into the external video image inputport 34 when the first processor 3 is connected with the secondprocessor 4. The input second image information Dg2 is output to thecontrol unit 35. The second image information Dg2 is obtained byperforming predetermined image processing on the second imaging signalgenerated by the image sensor 21B of the second scope 2B and the textualinformation is not superimposed in the second image information Dg2.

The control unit 35 includes a CPU. The control unit 35 controlsprocessing operation of each of portions of the first processor 3 byperforming operation including transfer of instruction information anddata to each of components of the first processor 3. In a case where thefirst scope 2A is attached to the first processor 3, the control unit 35is connected to the image sensor 21A and the memory 22A of the firstscope 2A via individual cables, and controls the image sensor 21A andthe memory 22A.

The control unit 35 is communicably connected to the server 7 via anetwork, or the like. The control unit 35 is communicably connected tothe control unit 44 of the second processor 4 via a cable. The controlunit 35 controls processing of the image processing unit 31 according tocommunication with the second processor 4. The control unit 35 includesa communication unit 351, a mode selector 352, a textual informationacquisition unit 353, and an image selector 354.

The communication unit 351 communicates with the control unit 44 of thesecond processor 4. In a case where communication with the secondprocessor 4 is established, the communication unit 351 transmits a textsuperimposing unnecessary command (first command) Cu indicatingnon-execution of superimposing of textual information on the secondimage information Dg2, and transmits an image information output command(second command) Cg indicating transmission of the second imageinformation Dg2 to the first processor 3, to the image processing unit41 via the control unit 44 of the second processor 4 to be describedbelow.

In accordance with the communication with the second processor 4 in thecommunication unit 351, the mode selector 352 selects any of a standardmode and a compatible mode. As image information composed by thecomposing unit 32, the first image information Dg1 generated by theimage sensor 21A of the first scope 2A is selected in the standard mode,and the second image information Dg2 input from the second processor 4is selected in the compatible mode. The mode selector 352 selects thecompatible mode in a case where the second scope 2B connected to thesecond processor 4 is selected and communication is established betweenthe communication unit 351 and the second processor 4. In a case wherethe first scope 2A connected to the first processor 3 is selected, themode selector 352 selects the standard mode of superimposing the firstimage information Dg1 obtained by performing image processing on thefirst imaging signal generated by the image sensor 21A inside the firstprocessor 3, and the textual information. The mode selector 352 controlsthe image processing unit 31 so as to perform image processingcorresponding to the selected mode. The mode selector 352 causes thecomposing unit 32 of the image processing unit 31 to generate a composedimage by superimposing the image information selected by the imageselector 354 described below and the textual information related to theimage information.

The textual information acquisition unit 353 obtains textual informationrelated to the image information input from the input apparatus 5described below. When the first scope 2A is attached, the textualinformation acquisition unit 353 obtains textual information related tothe first image information Dg1. When the second scope 2B is attached,the textual information acquisition unit 353 obtains textual informationrelated to the second image information Dg2.

The image selector 354 selects any one of the first image informationDg1 based on the first imaging signal generated by the image sensor 21Aand the second image information Dg2 based on the second imaging signalgenerated by the image sensor 21B input from the second processor 4corresponding to the mode selected by the mode selector 352. In a casewhere the mode selector 352 selects the standard mode, the imageselector 354 selects the first image information Dg1 input from theimage processing unit 31 and outputs the selected information to thecomposing unit 32. In a case where the mode selector 352 selects thecompatible mode, the image selector 354 selects the second imageinformation Dg2 input from the second processor 4 and outputs theselected information to the composing unit 32. The image selector 354selects the second image information Dg2 input from the second processor4 in accordance with the image information output command Cg transmittedby the communication unit 351 to the second processor 4.

The recording image generator 36 generates release image information andmoving image information for recording by performing codec processing onthe image information output from the image processing unit 31. Uponreceiving a moving image generation instruction signal from the controlunit 35, the recording image generator 36 generates (by encoding) movingimage information of a predetermined format from a series of continuousimage information output from the image processing unit 31 and outputsthe generated information to the server 7. Upon receiving a releasesignal from the control unit 35, the recording image generator 36generates release image data from the image information output from theimage processing unit 31, and outputs the generated release image datato the server 7. In a case where the mode selector 352 selects thestandard mode, the image processing unit 31 outputs a composed imagebased on the first image information Dg1. Accordingly, the recordingimage generator 36 generates recording image information such as movingimage data or release image data based on the composed imageinformation. In a case where the mode selector 352 selects thecompatible mode, the image processing unit 31 outputs a composed imageG2 based on the second image information Dg2. Accordingly, the recordingimage generator 36 generates recording image information such as movingimage data or release image data based on the composed image G2.

The storage unit 37 includes a volatile memory and a non-volatilememory, and stores various programs for operating the first processor 3.The storage unit 37 temporarily stores the information being processedby the first processor 3. The storage unit 37 stores the first imagingsignal output from the first scope 2A. The storage unit 37 may also beformed with a memory card, or the like, attached from outside of thefirst processor 3.

The second scope 2B is detachably attached to the second processor 4.The second processor 4 generates the second image information Dg2obtained by performing predetermined image processing on the secondimaging signal transmitted from the attached second scope 2B. The secondprocessor 4 is communicably connected to the first processor 3 andinputs the generated second image information Dg2 into the externalvideo image input port 34 of the first processor 3. The second processor4 includes the image processing unit 41, a panel switch unit 43, thecontrol unit 44, a recording image generator 45, and a storage unit 46.

The image processing unit 41 performs predetermined image processing onthe second imaging signal generated by the image sensor 21B of thesecond scope 2B. Similarly to the image processing unit 31, the imageprocessing unit 41 generates the second image information Dg2 byperforming optical black subtraction (OB) processing, demosaicingprocessing, white balance (WB) adjustment processing, electronic zoomprocessing, edge enhancement processing, mask processing, or the like,on the second imaging signal (digital) generated by the image sensor21B. The image processing unit 41 includes a composing unit 42 thatperforms OSD processing. The OSD processing in the composing unit 42 isnot executed under the control of the control unit 44 in some cases.Note that, in some cases, the image sensor 21B of the second scope 2Bperforms processing up to the noise reduction processing, clampprocessing, and A/D conversion processing, and outputs the secondimaging signal (digital). In a case where the second processor 4 is usedas a standalone unit, the image processing unit 41 converts a composedimage in which the second image information Dg2 and textual informationare superimposed into a format that may be displayed on a display device(not illustrated) included as a set with the second processor 4 andoutputs the converted composed image.

The panel switch unit 43 is a switch group provided on a front panelconstituting a casing of the second processor 4. In a case where thesecond scope 2B is attached to the second processor 4, the panel switchunit 43 receives an input of signals for freeze, release, and imageadjustment (emphasis, electronic enlargement, color tone, etc.) onto thein-vivo image captured by the second scope 2B, and outputs the receivedvarious signals to the control unit 44.

Similarly to the control unit 35, the control unit 44 includes a CPU andcontrols processing operation of each of portions of the secondprocessor 4 by performing operation including transfer of instructioninformation and data to each of components of the second processor 4. Ina case where the second scope 2B is attached to the second processor 4,the control unit 44 is connected to the image sensor 21B and the memory22B of the second scope 2B via individual cables, and controls the imagesensor 21B and the memory 22B. The control unit 44 is communicablyconnected to the control unit 35 of the first processor 3 via a cable.The control unit 44 controls processing of the image processing unit 41in accordance with the text superimposing unnecessary command Cu and theimage information output command Cg transmitted from the control unit35.

The recording image generator 45 includes the similar function as therecording image generator 36. Note that in a case where the secondprocessor 4 is communicably connected with the first processor 3 and thecompatible mode is selected in the first processor 3, the recordingimage generator 36 in the first processor 3 generates a release imageinformation or a moving image information from the second imageinformation Dg2. Accordingly, the recording image generator 45 does notexecute generation processing of the release image information or themoving image information.

Similarly to the storage unit 37, the storage unit 46 is formed with avolatile memory, a nonvolatile memory, or the like, and stores variousprograms needed to operate the second processor 4 and the second imagingsignal output from the second scope 2B, and in addition, temporarilystores information being processed by the second processor 4. Thestorage unit 46 may also be formed with a memory card, or the like,attached from outside of the second processor 4.

The input apparatus 5 includes an operation device such as a mouse, akeyboard and a touch panel. The input apparatus 5 receives input ofvarious types of instruction information and inputs the received varioustypes of instruction information to the control unit 35 of the firstprocessor 3. In a case where the first processor 3 and the secondprocessor 4 are communicably connected with each other, it receivesinput of instruction information toward the second processor 4 andtoward the second scope 2B attached to the second processor 4, andinputs the received instruction information to the control unit 35, inaddition to the various types of instruction information toward thefirst processor 3. Moreover, the input apparatus 5 inputs into thecontrol unit 35 scope selection information Dm indicating that eitherthe first scope 2A or the second scope 2B has been selected as the scopeto be used, and textual information Dk1 related to the image informationas a composition process target by the composing unit 32.

The display device 6 is configured with a display using a liquid crystalor organic EL. The display device 6 displays various types ofinformation including the display image output from the first processor3. In the case of the standard mode, the display device 6 displays acomposed image in which the first image information Dg1 based on thefirst imaging signal of the first scope 2A and the textual informationrelated to the first image information Dg1 are superimposed. In the caseof the compatible mode, the display device 6 displays a composed imageG2 in which the second image information Dg2 based on the second imagingsignal of the second scope 2B and the textual information related to thesecond image information Dg2 are superimposed. With this configuration,the user may observe a desired position inside the subject and judgeconditions by operating the first scope 2A and the second scope 2B whileviewing an image (in-vivo image) displayed by the display device 6. Notethat, under the control of the control unit 35, the display of thedisplay device 6 also displays information indicating whether theactually displayed in-vivo image is obtained by the first scope 2A orthe second scope 2B.

The server 7 is connected with the first processor 3 via a network, orthe like, and communicates with the first processor 3. The server 7includes a database (not illustrated), and records and manages varioustypes of information including identification information of the releaseimage information, the moving image information, and the image signalsoutput by the first processor 3, in a database.

FIG. 2 is a flowchart illustrating setting of the standard mode or thecompatible mode by the control unit 35 of the first processor 3 and aprocessing procedure of control processing of internal processing of thefirst processor 3 in accordance with individual modes. In the firstprocessor 3, the standard mode is set as the default mode.

As illustrated in FIG. 2, the control unit 35 determines whether thesecond scope 2B has been selected as the scope to be used based on thescope selection information Dm, or the like, input from the inputapparatus 5 (Step S1). In a case where the control unit 35 determinesthat the second scope 2B is not selected (Step S1: No), the modeselector 352 continues the standard mode (Step S2).

In contrast, in a case where the control unit 35 determines that thesecond scope 2B is selected (Step S1: Yes), the control unit 35determines whether communication is established between the firstprocessor 3 and the second processor 4 based on communication results onthe communication unit 351 (Step S3). In a case where the control unit35 determines that communication is not established between the firstprocessor 3 and the second processor 4 (Step S3: No), the control unit35 returns to Step S1, and determines whether the second scope 2B isselected.

In a case where the control unit 35 determines that communication isestablished between the first processor 3 and the second processor 4(Step S3: Yes), the mode selector 352 selects the compatible mode (StepS4), and the control unit 35 performs compatible mode control processingof controlling the image processing unit 31 so as to correspond to thecompatible mode (Step S5).

FIG. 3 is a flowchart illustrating a processing procedure of thecompatible mode control processing illustrated in FIG. 2. As illustratedin FIG. 3, the communication unit 351 transmits the text superimposingunnecessary command Cu to the second processor 4 (Step S11). In thesecond processor 4, the OSD processing in the composing unit 42 is notexecuted in response to reception of the text superimposing unnecessarycommand Cu. The textual information acquisition unit 353 obtains thetextual information Dk1 input from the input apparatus 5 (Step S12) andoutputs the obtained information to the composing unit 32.

The communication unit 351 transmits the image information outputcommand Cg to the second processor 4 (Step S13). In response to thereception of the image information output command Cg, the secondprocessor 4 outputs the second image information Dg2 in a state wheretextual information is not superimposed from the image processing unit41, and then, the control unit 35 receives the second image informationDg2 output from the second processor 4 (Step S14) via the external videoimage input port 34. The image selector 354 selects the second imageinformation Dg2 input from the second processor 4 and outputs theselected information to the composing unit 32 (Step S15).

The composing unit 32 generates the composed image G2 by superimposingthe input second image information Dg2 and textual information Dk1 (StepS16), and the generated composed image G2 is output to the displaydevice 6 (Step S17) and displayed on the display of the display device6. In the case of receiving the release signal, the control unit 35causes the recording image generator 36 to first generate release imageinformation from the composed image G2 and then output the generatedrelease image information to the server 7.

The control unit 35 determines whether the next second image informationDg2 has been received from the second processor 4 (Step S18). In a casewhere the control unit 35 determines that the next second imageinformation Dg2 has been received from the second processor 4 (Step S18:Yes), the control unit 35 returns to Step S15 and continues processingon the next second image information Dg2. In a case where the controlunit 35 determines that the next second image information Dg2 has notbeen received from the second processor 4 (Step S18: No), thecompatibility mode control processing is finished.

FIG. 4 is a diagram illustrating an exemplary composed image displayedon a display device connected to a conventional processor as a parentdevice. FIG. 5 is a diagram illustrating an exemplary composed imagedisplayed on a display device in the endoscope system according to thefirst embodiment. As illustrated in FIG. 4, conventionally, any of theprocessors regardless of distinction between child and parent devicesgenerates a composed image by superimposing textual information andimage information captured by the scope and outputs the generatedcomposed image to the processor as the parent device. Therefore, when acomposed image in which image information Ggp and textual informationGk′ are superimposed is input into the processor as the parent devicefrom the processor as the child device, the textual image Gk is furthersuperimposed on the input composed information. As a result,conventionally, the display device connected to the parent device hasthe output of the composed image Gp in which the two pieces of textualinformation Gk and Gk′ being superimposed on the image information Ggpas an observation target. In this case, it is difficult for the user todiscriminate which is correct textual information between the two piecesof textual information Gk and Gk′ in the composed image Gp, leading tothe difficulty in reading necessary information.

In contrast, in the first embodiment, as illustrated in FIG. 5, thecontrol unit 35 transmits the text superimposing unnecessary command Cufrom the first processor 3 as the parent device, and causes the secondprocessor 4 as the child device to output solely the second imageinformation Dg2 on which no textual information is superimposed.Subsequently, the control unit 35 then generates the composed image G2by superimposing solely one piece of textual information Dk1 related tothe second image information Dg2 obtained by the textual informationacquisition unit 353 on the second image information Dg2 and displaysthe composed image G2 on the display device 6. In the composed image G2in which solely one piece of textual information Dk1 is superimposed onthe second image information Dg2, other images and a plurality of piecesof textual information are not superimposed on the textual informationDk1 and the second image information Dg2, and thus, the user mayproperly read necessary information.

As described above, according to the first embodiment, the firstprocessor 3 controls the processing of the image processing unit 31 inaccordance with the communication with the second processor 4, making itpossible to generate a composed image in which solely the textualinformation necessary for image information is superimposed and nounnecessary texts or other images are superimposed even in a case wherethe display device 6 and the recording apparatus are shared with thefirst processor 3 and the second processor 4. In other words, in thefirst embodiment, the first processor 3 may generate an appropriatecomposed image from which the user may read the necessary information,leading to achievement of smooth diagnosis by the user.

First Modification of First Embodiment

FIG. 6 is a flowchart illustrating setting of the standard mode or thecompatible mode by the control unit 35 of the first processor 3 andanother processing procedure of control processing of internalprocessing of the first processor 3 in accordance with individual modes.

As illustrated in FIG. 6, the control unit 35 detects the presence orabsence of an input of the second image information Dg2 from the secondprocessor 4 into the first processor 3 based on the presence or absenceof reception of the second image information Dg2 on the image selector354 (Step S21). In a case where the control unit 35 detects the input ofthe second image information Dg2 from the second processor 4 into thefirst processor 3 (Step S21: Yes), the control unit 35 detects theconnection with the second processor 4 (Step S22). Subsequently, thecontrol unit 35 determines whether communication is established betweenthe first processor 3 and the second processor 4 based on acommunication result of the communication unit 351 (Step S24). In a casewhere the control unit 35 does not detect the input of the second imageinformation Dg2 from the second processor 4 into the first processor 3(Step S21: No) or determines that communication is not establishedbetween the first processor 3 and the second processor 4 (Step S24: No),the mode selector 352 continues the standard mode (Step S23). In a casewhere the control unit 35 determines that communication has beenestablished between the first processor 3 and the second processor 4(Step S24: Yes), the mode selector 352 selects the compatible mode (StepS25). Step S26 corresponds to Step S5 illustrated in FIG. 2.

As illustrated in the first modification of the first embodiment, it isallowable to configure to cause the first processor 3 to be able toautomatically select the compatible mode in a case where the firstprocessor 3 detects the input of the second image information Dg2 by thesecond processor 4 into the first processor 3 and in the case where thecommunication is established with the second processor 4.

Second Modification of First Embodiment

FIG. 7 is a schematic diagram illustrating a general configuration of anendoscope system according to a second modification of the firstembodiment. As illustrated in FIG. 7, a first processor 3A includes animage processing unit 31A and a control unit 35A instead of the imageprocessing unit 31 and the control unit 35 illustrated in FIG. 1, andfurther includes a changeover unit 38A.

The image processing unit 31A outputs the first image information thathas undergone the predetermined image processing to the changeover unit38A. The control unit 35A has a configuration in which the imageselector 354 of the control unit 35 is deleted. Moreover, similarly tothe mode selector 352, a mode selector 352A selects one of the standardmode and the compatible mode and causes the changeover unit 38A toswitch the image information to be output. The external video imageinput port 34 inputs the input second image information Dg2 into thechangeover unit 38A.

The changeover unit 38A includes an electronic circuit for outputtingsolely one of the two input signals. Under the control of the modeselector 352A, the changeover unit 38A selects, as the image informationto be output to the composing unit 32, the first image information Dg1input from the image processing unit 31A and the second imageinformation Dg2 input from the external video image input port 34. In acase where the mode selector 352A selects the standard mode, thechangeover unit 38A selects and outputs the first image information Dg1.In this case, the composing unit 32 generates a composed image bysuperimposing the first image information Dg1 and the textualinformation. In a case where the mode selector 352A selects thecompatible mode, the changeover unit 38A selects and outputs the secondimage information Dg2. In this case, the composing unit 32 generates thecomposed image G2 by superimposing the second image information Dg2 andthe textual information Dk1.

The control unit 35A of the first processor 3A performs the processingprocedure illustrated in FIG. 2 or 6 and sets the standard mode or thecompatible mode. FIG. 8 is a flowchart illustrating the processingprocedure of the compatible mode control processing by the control unit35A of the first processor 3A.

Steps S31 to S33 illustrated in FIG. 8 correspond to Steps S11 to S13illustrated in FIG. 3, respectively. The mode selector 352A causes thechangeover unit 38A to switch the output signal to the second imageinformation Dg2 input from the external video image input port 34 (StepS34). The first processor 3A receives the second image information Dg2input on the external video image input port 34, from the secondprocessor 4 (Step S35). The received second image information Dg2 isoutput from the changeover unit 38A to the composing unit 32. Steps S36to S38 correspond to Steps S16 to S18 illustrated in FIG. 3,respectively. With this configuration, the composing unit 32 generatesthe composed image G2 by superimposing the second image information Dg2and textual information Dk1, and the generated composed image G2 isdisplayed on the display of the display device 6.

As illustrated in the second modification of the first embodiment, it isallowable to switch image information to be output to the composing unit32 to either the first image information Dg1 or second image informationDg2 using hardware (changeover unit 38A) as a portion of the selector.

Second Embodiment

Next, a second embodiment will be described. FIG. 9 is a schematicdiagram illustrating a general configuration of an endoscope systemaccording to the second embodiment. As illustrated in FIG. 9, theendoscope system according to the second embodiment includes a firstprocessor 203 and a second processor 204.

The first processor 203 includes a control unit 235 having acommunication unit 2351 and a textual information acquisition unit 2353.The communication unit 2351 transmits a text superimposing unnecessarycommand Cu, an image information output command Cg, and an informationoutput command (third command) Ck instructing transmission of textualinformation Dk2 related to the second image information Dg2 to the imageprocessing unit 41 via a control unit 244 of the second processor 204.The textual information acquisition unit 2353 obtains the textualinformation Dk2 transmitted from the second processor 204 in response tothe textual information output command Ck transmitted from thecommunication unit 2351 as textual information to be superimposed on theimage information to as a composing target. Note that in the secondembodiment, solely the scope selection information Dm is input from theinput apparatus 5.

The second processor 204 includes the control unit 244. In addition tothe second image information Dg2 based on the second imaging signaloutput from the second scope 2B, the second processor 204 also registersbeforehand the textual information Dk2 related to the second imageinformation Dg2, and the control unit 244 transmits the textualinformation Dk2 to the communication unit 2351 of the first processor203 in accordance with the textual information output command Ck.

The control unit 235 of the first processor 203 sets the standard modeor the compatible mode by performing a processing procedure illustratedin FIG. 2 or 6. FIG. 10 is a flowchart illustrating a processingprocedure of compatible mode control processing by the control unit 235of the first processor 203.

Step S41 illustrated in FIG. 10 corresponds to Step S11 illustrated inFIG. 3. The communication unit 2351 transmits the textual informationoutput command Ck to the second processor 204 (Step S42). In response tothe reception of the textual information output command Ck, the secondprocessor 204 outputs the textual information Dk2 from the control unit244, and then, the control unit 235 receives the textual information Dk2output from the second processor 204 (Step S43) via the external videoimage input port 34. Steps S44 to S49 correspond to Steps S13 to S18illustrated in FIG. 3, respectively. FIG. 11 is a diagram illustratingan exemplary composed image displayed on a display device in theendoscope system according to the second embodiment. By executing thecompatible mode control processing illustrated in FIG. 10, a composedimage G2 a is generated and displayed on the display device 6. Thecomposed image G2 a is an image in which only the textual informationDk2 transmitted from the second processor 204 is superimposed on thesecond image information Dg2 without textual information beingsuperimposed, as illustrated in FIG. 11.

In the second embodiment, the first processor 203 obtains usingcommunication the textual information Dk2 such as patient informationregistered beforehand in the second processor 204 as a child device, andgenerates a composed image G2 a by superimposing the obtained textualinformation Dk2 on the second image information Dg2. With thisconfiguration, the second embodiment makes it possible to use thetextual information Dk2 once registered in the second processor 204without registering it again to the first processor 203. Note that, inthe second embodiment, the configuration is not limited to the casewhere the textual information acquisition unit 2353 superimposes thetextual information Dk2 transmitted from the second processor 204 on thesecond image information Dg2 obtained from the second processor 204. Itis also allowable to configure such that the textual information Dk2obtained from the second processor 204 may be superimposed on the firstimage information generated by the first processor 203. According tothis configuration, in the case where there is inspection experience bythe second processor 204 in the past and the case of re-inspecting apatient with a patient ID, or the like, being accumulated in the secondprocessor 204 by the first processor 203, it is not necessary to inputtextual information again on the first processor 203.

First Modification of Second Embodiment

A first modification of the second embodiment is an exemplary case wherein the first processor, the second image information Dg2 obtained fromthe second processor 204 further undergoes correction processing andthen is composed with textual information. FIG. 12 is a schematicdiagram illustrating a general configuration of an endoscope systemaccording to the first modification of the second embodiment. Asillustrated in FIG. 12, a first processor 203A in the first modificationof the second embodiment includes an image processing unit 231A having acorrection unit 239A and includes a control unit 235A having an imageselector 2354A.

The correction unit 239A performs correction and interpolationprocessing on the input image information corresponding to thegeneration of the first processor 203A. Since the first processor 203Ais a new generation processor having compatibility with the secondprocessor 204, the first processor 203A may execute upper gradecorrection processing as compared with the second processor 204.

In a case where the mode selector 352 selects the standard mode, theimage selector 2354A outputs the first image information Dg1 to thecomposing unit 32. In a case where the mode selector 352 selects thecompatible mode, the image selector 2354A outputs the second imageinformation Dg2 to the correction unit 239A. The second imageinformation Dg2 undergoes predetermined correction and interpolationprocessing by the correction unit 239A and then output as second imageinformation Dg2′. The composing unit 32 generates a composed image G2 a′by superimposing the second image information Dg2′ and the textualinformation Dk2 related to the second image information Dg2′. As aresult, the composed image G2 a′ having the second image informationDg2′ corrected by the correction unit 239A of the first processor 203Ais displayed on the display device 6.

The control unit 235A of the first processor 203A sets the standard modeor compatible mode by performing processing procedures illustrated inFIG. 2 or 6. FIG. 13 is a flowchart illustrating a processing procedureof compatible mode control processing by the control unit 235A of thefirst processor 203A.

Steps S51 to S55 illustrated in FIG. 13 correspond to Steps S41 to S45illustrated in FIG. 10, respectively. The image selector 2354A selectsthe second image information Dg2 input from the second processor 204 andoutputs the selected information to the correction unit 239A (Step S56).The correction unit 239A performs a predetermined correction processingon the input second image information Dg2 (Step S57). Steps S58 to S60correspond to Steps S47 to S49 illustrated in FIG. 10, respectively.

As in the first modification of the second embodiment, the firstprocessor 203A may first perform new-generation correction processing onthe second image information Dg2 output from the second processor 204and then may generate the composed image so as to achieve further smoothimage confirmation by the user.

Note that in the second embodiment, similarly to the second modificationof the first embodiment, the image information to be output to the imageprocessing units 231 and 231A may be converted into the first imageinformation Dg1 or the second image information Dg2 using hardware(changeover unit 38A).

Moreover, while the first and second embodiments are the cases where thesecond processors 4 and 204 output, as the second image information Dg2,image information generated by performing by the image processing unit41 predetermined image processing on the second imaging signal (digital)generated by the image sensor 21B, the present disclosure is not limitedto this. The second processor 4 and 204 may output the second imagingsignal (digital) generated by the image sensor 21B, that is, a signal inthe RAW data format as the second image information Dg2 to the controlunits 35, 35A, 235, and 235A of the first processors 3, 3A, 203, 203A.In a case where the second image information Dg2 in the RAW data formathas been input as the image information to be composed from the imageselectors 354 and 2354A or the changeover unit 38A to the imageprocessing units 31, 31A, 231, and 231A, the image processing unit 31first performs predetermined image processing such as OB processing, andthen generates a composed image with the textual information Dk1 and Dk2in the composing unit 32. Moreover, in accordance with instructioninformation from the input apparatus 5, the control units 35, 35A, 235,and 235A may obtain image information recorded in the past from thestorage unit 37 or the database of the server 7 to be connected, and maycause the composing unit 32 to generate a composed image with thetextual information Dk1 and Dk2 similarly toward to the obtained imageinformation.

The running programs for individual processing to be executed in thefirst processors 3, 3A, 203, and 203A, the second processors 4 and 204,and in other units, according to the first and second embodiments, maybe recorded on a computer readable recording medium such as a CD-ROM, aflexible disk, a CD-R and a DVD in a form of a file that may beinstalled or executed, and may be provided. Alternatively, the programmay be stored on a computer connected to a network such as the Internetand may be supplied by downloading the program via the network. It isalso allowable to provide or distribute the program via a networkincluding the Internet.

According to the present disclosure, it is possible to generate anappropriate composed image from which the user may read necessaryinformation in a case of generating a composed image in which textualinformation is superimposed on image information input from anothersignal processing apparatus.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the disclosure in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. A first signal processing apparatus to which afirst endoscope apparatus including a first image sensor is detachablyattached, the first signal processing apparatus being communicablyconnected to a second signal processing apparatus to which a secondendoscope apparatus including a second image sensor is attached, andbeing configured to process an imaging signal generated by one of thefirst image sensor and the second image sensor, the first signalprocessing apparatus comprising: an image processing unit configured toat least execute a composition process of generating composed imageinformation in which first image information based on the imaging signalgenerated by the first image sensor of the first endoscope apparatus orsecond image information input from the signal processing apparatusbased on the imaging signal generated by the second image sensor of thesecond endoscope apparatus and textual information related to the firstimage information or to the second image information are superimposed;and a control unit configured to control the process of the imageprocessing unit in accordance with communication with the second signalprocessing apparatus, wherein the control unit selects either one of thefirst image information and the second image information, and when thesecond image information is selected, the control unit outputs a firstcommand for instructing the second signal processing apparatus not tosuperimpose the second image information and the textual informationrelated to the second image information, and causes the image processingunit to generate composite image information in which the second imageinformation and the textual information related to the second imageinformation are superimposed.
 2. The first signal processing apparatusaccording to claim 1, wherein the control unit includes an imageselector configured to select one of the first image information and thesecond image information in accordance with the communication with thesecond signal processing apparatus, and the control unit causes theimage processing unit to generate a composed image in which imageinformation selected by the image selector and textual informationrelated to the image information are superimposed.
 3. The first signalprocessing apparatus according to claim 2, further comprising acommunication unit configured to communicate with the second signalprocessing apparatus, wherein the second signal processing apparatusexecutes a composition process of superimposing the second imageinformation and textual information related to the second imageinformation, the communication unit transmits, when the communicationwith the second signal processing apparatus is established, to thesecond signal processing apparatus the first command and a secondcommand instructing transmission of the second image information to thefirst signal processing apparatus, and the image selector selects thesecond image information input from the second signal processingapparatus in accordance with the transmission of the second command tothe second signal processing apparatus.
 4. The first signal processingapparatus according to claim 3, further comprising an input unitconfigured to input the textual information related to the second imageinformation, wherein the control unit causes the image processing unitto generate a composed image in which the second image informationselected by the image selector and the textual information input by theinput unit are superimposed.
 5. The first signal processing apparatusaccording to claim 3, wherein the communication unit transmits to thesecond signal processing apparatus a third command instructingtransmission of the textual information related to the second imageinformation in addition to the first command and the second command, andthe control unit causes the image processing unit to generate a composedimage in which the second image information selected by the imageselector and the textual information related to the second imageinformation input from the second signal processing apparatus inaccordance with the third command are superimposed.
 6. The first signalprocessing apparatus according to claim 2, wherein the image processingunit performs a correction process on the second image information, andwhen the image selector selects the second image information, thecontrol unit causes the image processing unit to generate a composedimage in which the second image information and the textual informationrelated to the second image information are superimposed after causingthe image processing unit to execute the correction process on thesecond image information.
 7. An endoscope system comprising: a firstsignal processing apparatus to which a first endoscope apparatusincluding a first image sensor is detachably attached; and a secondsignal processing apparatus to which a second endoscope apparatusincluding a second image sensor is attached, wherein the first signalprocessing apparatus and the second signal processing apparatus arecommunicably connected to each other, and the endoscope system performssignal processing on an image signal generated by the first image sensoror by the second image sensor, and wherein the first signal processingapparatus includes: an image processing unit configured to at leastexecute a composition process of generating composed image informationin which first image information based on the imaging signal generatedby the first image sensor of the first endoscope apparatus or secondimage information input from the signal processing apparatus based onthe imaging signal generated by the second image sensor of the secondendoscope apparatus and textual information related to the first imageinformation or to the second image information are superimposed; and acontrol unit configured to control the process of the image processingunit in accordance with communication with the second signal processingapparatus, wherein the control unit selects either one of the firstimage information and the second image information, and when the secondimage information is selected, the control unit outputs a first commandfor instructing the second signal processing apparatus not tosuperimpose the second image information and the textual informationrelated to the second image information, and causes the image processingunit to generate composite image information in which the second imageinformation and the textual information related to the second imageinformation are superimposed.